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Abstract 

We numerically study a dynamical system model of an idiotypic immune 
network with a small number of degrees of freedom. The model was originally 
introduced by Varela et.al, and describes antibodies interacting in a body in 
order to prepare for the invasion of external antigens. 

The main purpose of this paper is to investigate the direction of change 
in the network system when antigens invade it. We investigate three models, 
the original model, a modified model and a modified model with a threshold 
of concentration over which each antibody can recognize other antibodies. In 
all these models, both chaotic and periodic states exist. In particular, we find 
peculiar states organized in the network, the clustering states. 

We investigate the response of the system to invasions by antigens. We 
find that in some cases the system changes in a positive direction when it is 
invaded by antigens, and the clustering state can be interpreted as memories 
of the invasion by antigens. Further, from the investigation of the relaxation 
times for invasions by antigens, it is found that in a chaotic state the average 
response time takes an intermediate value. This suggests a positive aspect of 
chaos in immune networks. 



1. Introduction 



In this paper, we consider an immune network dynamical system model with 
small degrees of freedom. 

First, we explain the present understanding of immune systems briefly [0, ||. 

The main constituents of an immune system are B-lymphocytes(B-cells) pro- 
duced in the Bone marrow, T-lymphocytes(T-Cells) produced in the Thymus and 
free antibodies produced by B-cells. B-cells and T-cells have protein molecules called 
receptors on their surfaces. The receptors of B-cells are antibodies(Immunoglobulin, 
Ig), and antibodies recognize and connect to antigens to neutralize them. On the 
other hand, T-cell receptors(TcR) cannot recognize antigens, but they recognize 
pieces of antigens which appear on the surfaces of antigen presenting cells. When 
this happens, as a result, the helper T-cell expedites the immune response and the 
suppressor T-cell suppresses it. The killer T-cell attacks and kills a cell which is 
infected by viruses et.al. The receptors of B- and T-cells have proper 3-dimensional 
structures and these are called Tdiotypes'. A family of B-cells which are generated 
from a B-cell are called 'clones'. Therefore, a clone and antibodies produced by the 
clone have the same idiotype. 

In a human body, the total number of clones which are generated from a single 
B-cell are about 10 to 10^, the total number of clones amounts to 10^ and the number 
of antibodies is about 10^''. Thus, the repertoire of antibodies are enough to bind to 
any antigen. This diversity is due to the recombination and the mutation of genes. 

The response to the invasion by antigens is considered as follows. When antigens 
enter into a body, clones which can recognize the antigen bind to it, and maturate 
by the help of the helper T-cells, and a part of them proliferate. Others become 
antibody forming cells. In the antibody forming cells, many antibodies are produced 
and secreted. As a result, many antibodies appear and neutralize antigens. When 
the neutralization completes, by the action of the suppressor T-cells, the proliferation 
of B-cells is suppressed and the immune response ends. 

Further, in the course of the division of B-cells a part of each B-cells is preserved 
as a memory B-cell. When the same antigens enter into the body again, these cells 
rapidly differentiate into antibody forming cells and produce many antibodies in a 
short time. This phenomenon is called 'the secondary immune response'. 

In the mechanism of the immune response explained above, a clone of the B- 
cells which can recognize an antigen is selected. Thus, this theory is called 'clonal 
selection theory' and has been confirmed experimentally. 

B-cells, T-cells and antibodies die if they are not stimulated. As is mentioned 
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above, in a human body there are a huge number of these cells. To explain this, in 
1974 N. K. Jerne proposed the so-called network view of the immune systems 0. In 
his theory, these cells interact with and activate each other organizing a network. 
However, in 10 years after Jerne's theory appeared, the network theory was con- 
sidered to fail to live up to its initial promise. This is because the theory cannot 
explain the correct direction of change of the system when antigens invade a body. 
Another reason is that since T-cells and their actions were discovered, to include 
these elements the original theory would lose the simplicity which attracted many 
researchers. 

However, there are several experiments to support the network theory 0. For 
example, in new born mice activated lymphocytes are retained although mice are 
isolated from any antigen. That is, it seems that the immune system is activated 
by itself to prepare for the invasion of external antigens. 

Thus, taking into account T-cells and their roles F. J. Varela et.al. proposed the 
second generation immune network model in 1991 Since then, this theory has 
been developing 0, If. 

We would like to investigate the effects of the interaction among lymphocytes 
and antigens, and to analyze what kind of states and structures the network can 
have, and to see which directions the network moves to when antigens invade the 
system. Also, we have interest in mathematical structures of network systems from 
the view point of dynamical systems. 

In this paper, we study the dynamical system model of immune networks intro- 
duced by Varela et.al. In this model the essential characteristics of the real immune 
systems are taken into account. That is, not only antibodies, but also B-lymphocytes 
which produce antibodies, and the roles of T- lymphocytes, i.e., the activation and 
the suppression of B-lymphocytes, are included. 

In reality, an immune system has a huge number of degrees of freedom. How- 
ever, in this paper we focus on the Varela model with small number of degrees 
of freedom. Our objective is to investigate the possible states in the network and 
the change of these states when antigens invade the system in small systems, as 
a necessary step before studying the states of immune network and the immune 
response in large systems. Let us explain the model we treat in this paper. The 
constituents of the network, free antibodies and B-lymphocytes(B-cells), interact 
with each other through idiotypes. Let us distinguish idio types by index i. Between 
two different idiotypes i and j, there may occur an affinity, which is represented by 
the connectivity rriij. We assume rriij = 1 if there is an affinity between i and j and 
rriij = if not. rriij is measurable by experiments]^, Let us denote the concen- 
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tration of B-lymphocytes with the i-th idiotype by bi and that of free antibodies 
produced by the B-lymphocytes by /j. These antibodies have the same idiotype as 
the B-lymphocytes. The sensitivity of the network for the i-th idiotype is defined 
as follows; 

N 

(Ti^Y^mij/j, (1) 

where N is the number of idiotypes. It represents the strength of the influence by 
other antibodies to the i-th antibody. The number of B-lymphocytcs and antibodies 
change in time by the following causes. Free antibodies are removed from the con- 
stituents of the network because they have a natural lifetime and also they interact 
with other idiotypes and are neutralized. On the other hand they are produced by 
B-cells as a result of the maturation of B-cells. The probability of the maturation 
is assumed to depend on their sensitivity a. This effect is expressed by the function 
Mat{a). In the beginning of immune response, antibodies which interact with anti- 
gens maturate with help of T-cells. Then, it is natural to assume that the function 
Mat {a) is increasing with respect to a when a is small. If the number of antibodies 
becomes large, and the immune response comes to end, the creation of antibodies 
will be suppressed. Thus, for large values of a Mat{a) should be decreasing with 
respect to a. Thus, Mat{a) is assumed to have the convex profile illustrated in 
Fig.l. 

Then, a differential equation describing the change in time of the concentration 
fi of the i-th antibody can be written as 

^ = -K,aJ,-K2fi + KsMat{ai)b,, (2) 

where Ki is the rate of the neutralization by other antibodies, K2 is the rate of the 
death of the antibody and is the rate of the creation of the antibodies by B-cells. 

Correspondingly B-cells carrying i-th idiotype on their surfaces decay at a given 
rate and proliferate when they maturate. The probability of the proliferation of B- 
cells is represented by the function Prol{a). When B-cells maturate, they begin to 
proliferate. Again, Prol{a) is assumed to be increasing with respect to a when a is 
small. When the neutralization of antigens completes, the proliferation of B-cells is 
suppressed by T-cells. Therefore, we assume that Prol{a) is decreasing with respect 
to cr when a is large. Thus, Prol{a) also has the convex shape. Further, it seems 
that the proliferation of B-cells ends after their maturation ends, it is a reasonable 
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assumption that Prol{a) is shifted to right from Mat (cr) (Fig. 1). 

Then, the evolution equation for the concentration bi of the B-cells with i-th idiotype 

can be written as 

db- 

_L = -K,k + K,Prol{a,)h + K,, (3) 



where K4 is the death rate of the B-cells and is the rate of production of the B- 
cells. Further, the term Kq is added to take into account the cells that are recruited 
into the active network from the bone marrow. 

Here, let us see in detail how Mat{a) and Prol{a) work. First, let us consider 
Mat{a). 

When the sensitivity a is small, the B-cells are inactive. If the value of a becomes 
large, they are activated to maturate by helper T-cells and begin to produce anti- 
bodies. If the value of a increases further, the production of antibodies by B-cells is 
suppressed by the suppressor T-cells. As for the behavior of Prol{a), its behavior is 
similar to that of Mat{a). If sensitivity a becomes large, the B-cells are proliferated 
by the T-cells and then they produce many antibodies. If a increases further, this 
action is suppressed also by the T-cells. 

Next, we describe the version of the Varela model introduced by H. Bersini and 
B. Calenbuhr, which we investigate and modify in this paper. 

H. Bersini and V. Calenbuhr Q have investigated a dynamical system model of 
immune networks in the above framework using the following functions of the mat- 
uration and the proliferation in small degrees of freedom(Fig.2). 



Mat (cTj) = exp 
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(5) 



In their model, B-cells and antibodies with the same idiotype are considered to 
form a unit. By the interaction between two units the two-unit system oscillates 
and the phase of one unit is opposite to that of the other. 
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For a three-unit network, to begin with, they considered the connection between 
two units in an open chain fashion (Fig. 3 a). Then, three units can be constrained 
with opposite phases each other. 

Next, they considered the closed network by connecting three units as shown in 
Fig. 3b. The connectivity matrix they used is as follows, 



Although each pair of units must independently comply with the imposed constraint 
that they oscillate in opposite phases, it isn't possible for all units to satisfy this 
constraint. This phenomenon has been designated by the term "frustration" and 
occurs in a network with a closed loop composed of an odd number of units. In 
general, frustration induces instability. As a result of this instability, although the 
time evolution of each unit resembles the motion in an open chain network, this 
motion does not continue more than several oscillations, and the network behaves 
in random way. In the following section, we investigate the characteristics of the 
behaviors in the original model by Bersini and Calenbuhr. In §3, we modify the 
original model by adopting simpler functions of Mat{a) and Prol{a) and see the ef- 
fects of the choice of these functions. In the modified model, we consider a threshold 
over which each antibody can recognize others. This is introduced in §4. In §5, we 
consider the networks with more than 3 units and investigate the effect of degrees of 
freedom. Then the invasion of antigens is investigated in §6. Finally, §7 is devoted 
to summary and discussions. 

§2. The characteristics of the original model 

As is mentioned in the introduction, the system exhibits periodic oscillations 
for both the cases of two units and of the three-units open chain. On the other 
hand, for the case of the three-units closed chain, the system exhibits stable chaotic 
oscillations. 

In this system, there always exists the following fixed point 



and this point is stable. However, this solution has no meaning as a network because 
the interaction between units does not exist. 



1 1 

1 1 
1 1 



(6) 




(7) 
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First, to investigate the instability of the system, we calculated Lyapunov char- 
acteristic exponents in the original model and obtained the following result for the 
Lyapunov spectrum, 

(Ai,---,A6) = (+,+,0,-,-,-). 

This implies that the resultant strange attractor of this system is rather complicated 
in structure because there are two positive exponents. 

Since this model has permutational symmetry, it should be checked whether the 
chaos is robust with respect to symmetry breaking perturbations. To investigate 
this, we gave random values around 1 to rriij for i ^ j with ma fixed to 0, and 
studied the time evolution of the system. We found that chaotic behaviors could 
also be obtained for asymmetric systems. Thus the chaos in this model is robust 
and the cause of appearance of chaos is not the symmetry of the system. 

Next, to see how chaos appears in this system, we changed the strength of 
connectivity retaining the permutational symmetry in the system. To be specific, 
we set the connectivity matrix as follows. 



M = s X 



1 1 

1 1 
1 1 



(8) 



and lowered s from 1 to 0. Then, we obtained the following results. See Fig. 4. 

Until a rather small value of Sq ~ 0.4, the system exhibits chaotic motion. 
When s is less than sq; a trajectory converges to the fixed point. Thus, when the 
connectivity is small, this model is not adequate to describe the immune network. 
On the other hand, when we increased s from 1, at s ~ 1.7 a limit cycle appears 
and this breaks the permutational symmetry of numbering of units. 

As is shown in Fig. 5(a), the phase portraits of two of the units are the same 
but they oscillate in opposite phases to each other. We call these units long-pulse 
units. One unit has smaller amplitude than those of the other two units. We call it 
the short-pulse unit. Let us see the characteristic feature of the oscillation of this 
limit cycle. Let us take notice of the time series of antibodies (Fig. 5(b)). At almost 
all times, one of the long-pulse units has a large value of the concentration but 
others have small values. When the largest concentration of a long-pulse unit, say 
/i, becomes small, the other two /2 and increase taking similar values initially, 
then at some value of the concentrations, the concentration of the other long-pulse 
unit, say /2, becomes large and the short-pulse unit becomes small. Next, when 
/2 becomes small, this time /i and /a increase taking similar value and /i becomes 
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large and /a becomes small. Thus, it seems that the short-pulse unit plays a role of 
'switching' of the activation of the long-pulse units. We call this state a clustering 
state. 

As s is increased further, at s ~ 4.2. the permutational symmetry breaks completely 
and the medium-pulse unit appears. This state also can be called a clustering state 
and the role of switching is played by the short-pulse unit. 

At s ~ 4.7, the concentrations / and b in one unit are nearly equal to 0. Since this 
unit merely affects other units, we do not regard this state as a clustering state. 

As for the route to chaos at s ~ 1.7, it is considered to be Intermittency by 
heteroclinic intersections []. The sudden disappearance of chaos at s ~ 0.4 seems to 
be crisis, that is, the basin of chaos intersects with that of stable fixed point. 

There are several characteristic features of this model by Bersini and Calenbuhr, 
those are, the topological dimension of the resultant strange attractor is three, the 
chaos is hyperchaos, and the switching in the clustering state. Since in this model 
the functions Mat{a) and Prol{a) are rather complicated, it is interesting to in- 
vestigate whether these features are due to the special choice of these functions. 
In order to see the effect of these functions, we modify the above model by choos- 
ing simpler functions Mat{a) and Prol{a). In the next section, we go into this study. 

§3. Modified model 

We change the functions of the maturation and the proliferation as follows. 

Mat (ai) = Uix [tanh {U2 x (a^ - TiJ} (9) 

- tanh {f/3 X {ai - T„„)}] , 

Prol (ai) = t/4 X [tanh {f/5 x (a^ - T^p)} (10) 

- tanh {Uq X ((T,; - Tup)}] , 

where Ui ~ UQ,Tim,Tum,Tip and Tup are constants. In Fig. 6 we show the graphs of 
these functions. They look rather similar to those of the previous functions. 

When the above functions are adopted as Mat{a) and Prol{a) , in the case of 
two units, the system converges to a fixed point and in the case of the three-unit 
closed chain, a strange attractor appears. See Fig. 7. 

^It is reported by other authors that when some parameter is changed, this system shows 
Intermittency |^ . 
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The Lyapunov spectrum for chaos becomes as follows. 

(Ai,---,A6) = (+,0,-,-,-,-). 

Then, chaos in this system has lower dimension than that in the original system. 

To investigate the onset mechanism of chaos, we drew the bifurcation diagram 
decreasing the magnitude of connection matrix in the same manner as in the previous 
section. See Fig. 8. 

When s is decreased from 1 or increased from 1, the transition from the strange 
attractor to a limit cycle takes place suddenly at s ~ 0.94 or s ~ 1.5, respectively. 
For the limit cycle state which appears below s ~ 0.94, two of three units oscillate 
in opposite phases, and the other unit takes negligibly small values. Sec Fig. 9. 

On the other hand, for the limit cycle state which appears above s ~ 1.5, two 
of three units oscillate in opposite phases, and the other unit oscillates with smaller 
values. That is, the permutational symmetry is broken in these states. The limit 
cycle state which appears above s ~ 1.5 is considered to be a clustering state as 
discussed in §2. Sec Fig.5 and Fig. 10. 

To see the bifurcation phenomena below s = 1 in detail, we calculated the first 
Lyapunov characteristic exponent while decreasing the strength s of the connection 
matrix. See Fig.ll. 

There exists a definite critical point. In the chaos region, time series of bi exhibit 
regular oscillations interrupted by irregular motion. Thus the route to chaos from 
the limit cycle is Intermittency. In fact, we confirmed that in both transitions to 
chaos taking place at larger and smaller values of s than s — 1, the routes to chaos 
are Intermittency by heteroclinic intersections as in the original model. 

As for the robustness, wc checked that the system is robust with respect to 
permutational symmetry breaking perturbation as in the original model. 

From the results in this section, we conclude that except for the topological di- 
mensionality of the chaos, which is two in this model and three in the original one, 
all features are the same as those in the original model. Thus, the modified model 
is simpler than the original model. 

§4. The modified model with threshold 

In this section, we introduce a threshold over which antibodies can recognize 
antibodies and antigens. There are several reasons to take the threshold into ac- 
count. One is that it seems that there exists some threshold for the concentration of 
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antibodies to recognize antigens. Another reason is that we would hke to consider 
the situation in which the concentration of an antigen can become large without 
being recognized by antibodies for some reason. As such a situation we can consider 
the case that the ability of detecting antigens in the immune system becomes weak. 
Further, as a technical reason, introducing thresholds makes it possible to define 
states clearly. 

When the threshold is introduced, the system exhibits various interesting behav- 
iors. 



Threshold 

In the three-unit closed chain system, we introduce a threshold over which the 
i-th antibody can recognize other antibodies. For simplicity we take the common 
value /o of thresholds for all antibodies as follows. 



m. 



(t) = 1 for any i) when fj{t) > /o, 
(t) = for any i) when /^(t) < /o. 



That is, 

m,,(t)=m,,0(/,(t)-/o), (11) 

where 0(x) is the Heaviside function, i.e., Q{x) = 1 for a; > and for a; < 0. 
Hereafter, rriij in the right hand side of the above equation is fixed to the value in 
eq.(6). We scanned the value of the threshold fo every 5 values and obtained the 
following behaviors of the system. 

Limit cycles. The concentrations of B-cells of two units are 
/o = 5 ~ 15 < always greater than the threshold and the other is always 

less than it. (Fig. 12) 
/o ~ 20 Limit cycle with period two. 

/o = 25 - 40 Chaos. Fig. 13 

/o = 45 ~ 50 Limit cycles. Clustering state. (Fig. 14). 
fo > 55 Fixed point. 

For /o = 5 ~ 50, the system is in the clustering state which is defined in §2. In 
this state, each of three units oscillates taking values below and over the threshold. 
Two long-pulse units have longer duration over the threshold and the short-pulse 
unit has shorter duration. 

For the time series analysis, we define the on-off time series as follows. Let us 
associate or 1 with each unit according to the value of fi, that is, for /j < /o and 
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1 for fi > /o- We call the former the off-state and the latter the on-state, and the 
sequence of and 1 as a function of time the on-off time series. As shown in Fig. 15, 
at almost all times, there exists only one on-state, and whenever the long-pulse unit 
changes from the on-state to the off-state, the short-pulse unit becomes the on-state. 
That is, the short-pulse unit plays a role of switching. This is the same phenomenon 
as observed in §2 and §3. 

Thus, this phenomenon takes place in all models we studied. The cause of this 
phenomenon is ascribed to the nature of the interaction. We discuss this in the final 
section. 

If we take an initial state such that all units are less than the threshold, the 
system converges to the fixed point. On the other hand, if at least one unit exceeds 
the threshold initially, then the system goes to the clustering state. 

We investigated the bifurcation structure when the system is in the clustering 
state for /q = 50. To see the bifurcation structure clearly, we introduce the strength 
of effective interaction < I^j >. < I^j > is defined by the following relation. 



For example, if fi{t) > /o,/2(t) > /o and fsit) < /o, then m2i(t) = msi{t) = 
l,muit) = m32{t) = 1 and mi3(t) = m23(t) = 0. Thus, Ii2{t) = hiit) = 2,7i3(i) = 
hi{t) = 1 and /23(t) = /32(t) = 1. See Fig. 16. 

As s is lowered, the initial periodic state for s = 1 becomes chaos at s ~ 0.93, 
and the permutational symmetry is recovered. See Fig. 17. When s is lowered fur- 
ther, the periodic state appears again at s ~ 0.52(Fig.l8). 

We show the bifurcation diagram (Fig. 19) and the s dependence of < 1^ > (Fig. 20). 
Here, we summarize the result. 

1. si(~ 0.93) < s < 1. Limit cycle. (Clustering state.) Fig. 14. 

There occurs clustering and there are two groups of < lij >. That is, the 
interaction between two long-pulse units, say III, and the interaction between 
the long-pulse unit and the short-pulse unit , say Ils- Typical values are 




(12) 
(13) 



Iij{t) = mij{t) +mji{t). 



Ill ~ 0.83, hs ~ 0.8. 
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2. S2(~ 0.52) <s< si. Chaos. Fig.l7. 

All < lij > take almost the same values. The typical value is 

III ~ hs ~ 0.85. 

3. S3(~ 0.4) < s < S2- Limit cycle. Fig.18. 

As for the usual time series, one unit takes negligibly small values and the other 
two units oscillate in opposite phases. Then, the symmetry of this state is 
broken and two units always exceed the threshold and the other never exceeds 
the threshold. Reflecting these behaviors, the values of < lij > are divided 
into two groups, - in one group < lij > tends to 2 and in the other it tends to 
1 as s — > S3. Since one unit does not affect other units, it is not appropriate 
to call this a clustering state. 

4. < s < S3. Fixed point. 

There is no meaning of a network. 

From these observations, we note that < lij > can be used to distinguish the clus- 
tering state from other behaviors. In particular, in the state of chaos, all the < 1^ > 
take almost the same value. 

The Lyapunov spectrum for chaos is 

(Ai,---,A6) = (+,0,-,-,-,-), 

and is the same as in the modified model. 

The routes to chaos at s ~ 0.93 and s ~ 0.52 are also Intermittency by the 
heteroclinic intersections. 

§5. The effect of the degree of freedom 

Here we investigate the behaviors of the network when the number of units 

is increased for the modified model with threshold. We assume that there exists 
interactions between any two units and the connectivity matrix is symmetric, i.e., 
niij = rriji = 1 for any i and j {i ^ j). 

We investigated the cases of = 3, 4, • • • , 10. In Fig.21 and 22, we show phase 
portraits for several cases. 

The clustering state occurs in all cases. However, it seems that it takes place 
more frequently in the case of the odd number of units in the parameter ranges 
which we investigated. (Fig.21, 22) 
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Indeed, for = 3, 5, 7 and 9 and when the threshold is the same for all units, 
clustering takes place and for = 4, 6, 8 and 10, it does not. In the figures 21(b) 
and 22(b), we show the effective interactions schematically. In these figures thick 
lines denote large strength, thin lines represent medium strength and dotted lines 
represent small strength. When the clustering occurs, the system is in a limit cycle 
state, and the number of the long-pulse units is larger by one than that of the short- 
pulse units. There are three values of the strength of the effective interaction in the 
system. See Fig. 22(b). The strength of the effective interaction takes the largest 
value III between two long-pulse units, the smallest Iss between two short-pulse 
units and intermediate value between the long-pulse unit and the short-pulse unit. 
When the clustering does not occur in the system, the strengths of the effective 
interactions are almost the same. See Fig. 21(b). 

We show the on-off time series for = 3(Fig.l5), = 5(Fig.23), A^ = 4(Fig.24(a)) 
and A^ = 6(Fig.24(b)). 

From these figures we note that for A^ = 3 and 5, there are only two types of 
units, i.e., long-pulse units and short-pulse units. On the other hand, for A^ = 4 and 
6, in any unit, the duration time of the on-state varies in time. To clarify this we 
calculate the histogram of the duration time. See Fig. 25, 26, 27, 28. In the case of 
odd number of units, we notice that the duration time Tl for the long pulse unit is 
nearly twice as the duration time Ts for the short-pulse unit. On the other hand, in 
the case of even member of units, although there are various duration times, we can 
find two peaks of the long duration time and the short one. That is, in the chaotic 
state, the role of each unit changes dynamically. 

§6. The invasion of antigen 

Hereafter, we consider the response of the system to the invasion of antigens in the 
modified model with threshold. 
Case 1 

We consider the clustering state in the 3-units closed network. Suppose that 
external antigens similar to antibodies /i invade the system. Let us denote the 
concentration of the antigen by oi and that of the corresponding antibodies by /i. 
Then, antibodies /2 and /s recognize the antigens, because ai resemble /i. However, 
in general the antibodies /i cannot recognize the antigens. See Fig. 29. 

Further, we assume that the antigen does not proliferate by itself 0. Thus, the 

^This restricts the type of antigens. For example, pollen are one candidate. 
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differential equation for tlie antigen is given by 

^ = -K,aait)a, + Kj, (14) 

where a ait) = mi2{t)f2{t) + rrii^it) f^ij:) . Here, we assume that the antigens enter 
into the system at a rate per unit time. On the other hand, since antibodies /2 
and /s interact with the antigens, a2 and become (J2 = '"^21 (/i + ai)0(/i + ai — 
/o) + m23(t)f3 and 0-3 = m3i(/i + ai)6(/i + oi - /o) + m32(t)/2, respectively. Then 
using these crs the equations for antibodies and B-cells are the same as the previous 
ones. 

Now, let us see what happens in this system. The behavior of the system depends 
on the increase rate of the antigen Kf. If is large enough, say > Kj{r^ 1-2), 
the concentration of the antigen ai increases infinitely and the system is completely 
invaded and destroyed by the antigenQ. If is less than some value, say Kj < 
Kj{r^ 0.7), the system copes with the antigens completely. The number of antigens 
finally become small and the system settles near to a clustering state depending 
on the initial condition. Thus, in this case there is no memory of the invasion by 
antigens. 

If we set Kj between Kj and Kj, e.g., Kj = 0.7, ai does not increase infinitely 
but oscillates in some range of concentration. The time series of ai and the phase 
portrait of the system are drawn in Fig. 30 and 31, respectively. 
Although the system is modified because of the invasion by the antigen, for Kl^ < 
Kj < Kj, it still keeps the nature of the network as a whole. In the resultant state, 
the duration time of the on-state for /2 and are longer, i.e., the units 2 and 3 are 
long-pulse units. 

Now, let us study the response time of the system when Kj = 0. To do this, 
starting from ai = 50 we calculated the relaxation time in which the concentration 
of the antigen becomes negligibly small. See Figure 32. 

From this figure, we note that the response time is shorter in the state in which 
the units 2 and 3 are in the long-pulse units. In the resultant attractor the units 2 
and 3 are the long-pulse units. This result implies that the system modifies itself 
so as to neutralize the antigen as effectively as possible. Thus, it seems that the 
resultant state can respond much better than other states. 

Therefore, we can state that the resultant attractor is viewed as a kind of memory 
The system tends to the fixed point 
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of the invasion by the antigen.^ 

Further, we scanned the initial value of A-j with K-j fixed to 0.7. For Ai < 288, 
the system settles to a clustering state. On the other hand, for Ai > 288 the system 
tends to a fixed point and the network collapses. 
Case 2 

Next, we consider the case that an antigen Ai interacts only with the antibody 
/i in the 3- unit closed network. (Fig. 33). 

In this case, we set the thresholds depending on units in order to obtain clustering 
states. Here, we introduce new notations of thresholds, fifi{i = 1 ~ 3), gi^ and 
gA,o as follows, fi^ is the threshold over which the i-th antibody recognizes other 
antibodies, gi^ is the threshold over which the antibody /i recognizes the antigen 
and gA,o is the threshold over which the antigen Ai recognizes the antibody /i. Then 
the equation for the antigen Ai is 

^ = -K,aA{t)A, + Kj, (15) 

(rA{t) = Q{h-gi,o)fi- 

The first term expresses the decrease of the antigen by neutralization by the anti- 
body 1 and the second term represents the continuous invasion of the antigen. The 
sensitivity cTj of the i-th unit is modified to 

n 

a, = Y^rn^Mfj - ko)fj + kAiOiA, - gA,o), (16) 
i=i 

where k is the strength of the interaction between and Ai. We put k = s^^i,!, 
where 5i^i is the Kronecker's delta. The behavior of this network strongly depends 
on the thresholds, the value of connectivity sa, the initial value of the antigen Ai 
and the rate of invasion of the antigen K^. If these values are taken appropriately, 
the concentration of the antigen oscillates in some range. See Fig. 34. 

As in the case 1, the unit 1 which can interact with the antigen is activated and 
finally settles near to the long-pulse state. See Fig. 35. 

It turns out that the relaxation time of the concentration of the antigen is com- 
parable in this state with in the state where the unit 1 is in the short-pulse state. 

^ We use the term 'memory' to express the change to the positive direction of the system under 
the invasion by the antigens. It should not be confused with creation of memory B-ceUs. 
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See Fig.36. 

When we compare this result with the result in the case 1, it is considered that 
the number of units which can interact with antigens is important for the relaxation 
time. 
Case 3 

Now, let us consider the network with 4- units. We assume that the antigen (ai) 
has a similar three-dimensional structure to the antibody 1 and then can interact 
with the unit 2, 3 and 4, but cannot interact with the unit 1. See Fig. 37. 



The differential equation for the antigen is 

^ = -K,aa{t)a, + Kr, (17) 
(Ta{t) = (mi2(t)/2 + mi3(t)/3 + mu{t) U) ■ (18) 

For the unit i, the differential equations are 

^ = -K^a,{t)U-K^f, + K^Mat{ai{t))K (19) 

^ = -Kihi + K^Prol{ai{t))h + K^, (20) 
at 

<7i{t) = T.^ij{t)fj, (21) 



<Ji{t) = ma(/i + ai)e(/i + ai - /o) + ' + 1- (22) 

If we break the symmetry of the connectivity matrix by lowering the threshold 
of one of the four units, for some initial condition this unit stays in the short- 
pulse state and other units stay in the long-pulse states, and so the clustering takes 
place(Fig.38). For some other initial conditions, chaotic states appear. That is, in 
this case chaos and the clustering states coexist. 

From the result of the case 1, it is expected that the relaxation time of the 
system is short when the unit which resembles the antigen is in the short-pulse 
state. Further, from the result of the case 2, it is expected that the more is the 
number of units which interact with the antigens, the shorter is the relaxation time. 
Thus, here we investigate the relaxation time for the following three cases. 

Case a. The unit 1 is in the short-pulse state. 
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Case b. The unit 1 is in the long-pulse state. 
Case c. The system is chaos. 
We show the result in Fig. 39. 

The relaxation time for the case a is shortest and for the case b is longest. 
Tc for the case c is in between and r^. From this result, it is considered that chaos 
is more effective than the clustering states to prepare for various types of antigens. 

§7. Summciry and discussions 

In this paper, we studied the three models of the immune network for small number 
of degrees of freedom ~ 10, the original model introduced by Bersini et.al., the 
modified model with different functions of the maturation and the proliferation of B- 
cells from those of the original model, and the modified model with a threshold over 
which antibodies can recognize other antibodies and antigens. First, we summarize 
common characteristics of these models. 

In these models there exist limit cycle states and chaotic states. We investigated 
bifurcation structures obtained by changing several parameters and found that the 
transitions to chaos are Intermittency by heteroclinic intersections. 

There is a peculiar type of limit cycle. In this limit cycle, the permutational 
symmetry of the system is broken and concentrations of antibodies and B-cells 
oscillate in a characteristic manner. We call this the clustering state. 
In the clustering state, for example in the three-unit system, there are two long-pulse 
units in which the concentrations of antibodies are large and one short-pulse unit in 
which the concentration of the antibody is small. Two long-pulse units oscillate in 
anti-phase to each other. At almost all times, only one unit has a large concentration 
of the antibody. The short-pulse unit plays a role of "switching" the long-pulse units 
which take the large concentrations. 

On the other hand, in the state of chaos, no such explicit division of roles exist, 
but each unit changes its role dynamically. That is, in chaos, a dynamical change 
of roles takes place. 

We investigated the invasion by antigens when the clustering takes place. We 
found that when the number of antigens is not too many and interaction between 
antigens and antibodies continues for an appropriate period, the unit which can 
interact with antigens settles near to the long-pulse unit after the concentration of 
antigens is reduced to small values in some range of a parameter. 

By investigating the relaxation time, we found that in the clustering state the 
relaxation time depends on what state the system stays in. In the case 1 that the two 
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units interact with antigens the relaxation time is short or long when the unit which 
interacts with antigens is in the long-pulse unit or short-pulse unit, respectively. 
On the other hand, in the case 2 that only one unit interacts with antigens the 
relaxation time takes similar value both in the long-pulse unit and in the short- 
pulse unit. Thus, if many units can interact with antigens by the invasion of the 
antigens the system moves to the state in which the response to antigens is most 
efficient. Thus, the clustering state is considered to be a memory of the invasion by 
antigens. 

Further, we checked that the system is robust against the symmetry breaking 
perturbations. Chaotic and periodic states change only a little by these perturba- 
tions. 

As for the modified model with thresholds, we observed a interesting feature. The 
feature is the positive aspect of chaos in response to the invasion by antigens. In this 
model there is the coexistence of chaos and clustering states when the thresholds are 
chosen appropriately depending on units. In the response to the antigen invasion, we 
found that the relaxation time in chaotic state takes an intermediate value between 
the large and the small response times in the two types of clustering states. This 
suggests a positive aspect of chaos in immune networks, that is, the possibility that 
chaos may cope with the invasion by any kinds of antigens equally well. 

Now, let us discuss the cause of the appearance of clustering state. This is related 
to the mechanism of the switching of long-pulse units or the dynamical role change. 
Let us consider the 3-unit closed chain. See Fig.5(b), 10(b) and 40. In the present 
interaction, any two units tend to oscillate in opposite phases. If the concentration 
of the antibody in one unit, say fi, increases, then the sensitivities of other two units 
become large. By this, the second terms of the differential equations for /2 and /s 
become large and /2 and /a decrease. This is a kind of 'winner takes all' mechanism. 
Then, the sensitivity (Ji becomes small. Thus, when /i becomes large, the third 
term of the differential equation for /i becomes small compared to the other two 
terms. Thus, next fi begins decreasing. This causes the decrease of (T2 and (T3 and 
the increase of /2 and f-^. Since /2 and f-^ begin to increase from small values, these 
take similar values. However, when these become rather large, two units are forced 
to stay in states with opposite phases each other. Thus, one increases further and 
the other decreases. At this stage, for the clustering state, the increasing unit is 
fixed to the long-pulse unit, but for chaos, it is not fixed and the dynamical change 
of the switching role takes place. Therefore, the behavior of the switching is due to 
the 'winner takes all' mechanism and the 'anti-ferro' type interaction between any 
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two units. 

Next, let us discuss the causes of different beliaviors between tlie original model 
and the modified model without threshold. 

We studied influences of each of the terms in the 3-unit closed chain system. We pay 
attention to the unit 1 only, because we consider the case that the system 

has the permutational symmetry. The differential equations of /i and bi are 



dt 
dbi 



= -K,aJ,- K2h + KsMat{a,)b, (23) 



. -K^b, + K^Prol{a,)b, + Ke (24) 
at 



Here, we denote each term in the above equations as follows. 



F2 = -i^2/l, 

Fs = KsMat{ai)bu (25) 
B2 = K^Prol{a^)b^, 



We compare the time sequence in the original model with that in the modified model. 
See Fig.41,42. 

In these figures, solid lines denote Fi and Bi, large dotted lines represent F2 
and B2, small dotted lines represent -F3 and B^, respectively. We note that the 
terms concerning the maturation and the proliferation give the biggest infiuence on 
the behaviors of the system in both the models. In the original model these terms 
increase and decrease more rapidly than in the modified model. 
The chaos in the original model is hyperchaos but that in the modified model is not 
hyperchaos. The complexity and the large topological dimensionality for chaos in 
the original model seem to be due to sharp behaviors of these functions. However, 
to clarify the infiuence of the choice of these functions, it is necessary to perform 
further investigation. This is left to a future study. 

We considered the threshold over which the antibodies can recognize other anti- 
bodies. We can also consider a threshold over which the antigen can be recognized 
by other antibodies. This is another situation to be investigated. 
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In this study, we investigated three cases of invasions by antigens. In these cases, 
we have interest in the generic behaviors of the system when the several parameters 
are changed, e.g., the initial values of antigens or the input rate of the antigen K-j, 
etc. We found that in some cases the system changes in a positive way, that is, 
in the resultant state the relaxation time becomes shorter if there are plural units 
which interact with antibodies. There exists a kind of memory in the system. From 
the perspective of the real immune network, the existence of memory states and the 
response to the invasion by antigens in a system with large number of degrees of 
freedom are very interesting problems. These will be studied in the future. 
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Figure captions 



Fig.l Schematic figures for Mat (a) and Prol{a). 

Fig. 2 Mat{a) and Prol{a) used in tlie original model. 

Fig. 3 Type of connection, open and black circle are in the opposite phase. 

(a) 3-units open chain, (b) 3-units closed chain. 
Fig. 4 Bifurcation diagram in the original model. 

(a) s < 1, (b) s > 1. 
Fig. 5 Periodic solution at s = 1.7. 

(a) Phase portraits, (b) Time series of 5j. 
Fig. 6 Mat{a) and Prol{a) for the modified model. 
Fig. 7 Phase portrait of a strange attractor in the modified model. 
Fig. 8 Bifurcation diagram of the modified model. 
Fig. 9 Phase portrait of a limit cycle at s = 0.7. 
Fig. 10 Limit cycles at s = 1.57. 

(a) Phase portrait, (b) Time series. 
Fig. 11 The first Lyapunov exponents. 
Fig. 12 Phase portrait of a limit cycle at /o = 10. 
Fig. 13 Phase portrait of chaos at /o = 30. 
Fig. 14 Phase portrait of limit cycle at /o = 50. 
Fig. 15 On-off time series in a clustering state, s = 1, Jq = 50. 
Fig. 16 Effective interactions. 
Fig.l7 Chaos at s=0.8. 

(a) Phase portrait, (b) On-off time series. 
Fig. 18 Limit cycle at s=0.4 

(a) Phase portrait, (b) On-off time series. 
Fig. 19 Bifurcation diagram of the modified model with threshold. 
Fig. 20 s dependence of < >. 

Fig. 21 Attractor in 4-units system in the modified model with threshold. 

(a) Phase portrait, (b) Strength of effective interactions. 
Fig. 22 Attractor in 5-units system in the modified model with threshold. 

(a) Phase portrait, (b) Strength of effective interactions. 
Fig. 23 On-off time series for N — 5. 
Fig.24 On-off time series, (a) iV = 4. (b) iV = 6 
Fig. 25 Histogram of duration time. N = 3. 
Fig. 26 Histogram of duration time. N = 5. 
Fig. 27 Histogram of duration time. N = 4. 
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Schematic figure of interaction between antibodies 






and antigen in Case 3. 
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Clustering state. 
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Relaxation times in clustering states and in chaos. 


Fig 


.40 


Time series of limit cycle at /o = 50 in the modified model with threshold. 
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Time series of each term in the differential equations of the original model. 
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Time series of each term in the differential equations 






of the Modified model, (a) /i. (b) 61. 
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